Shapley values for cluster importance

Abstract This paper proposes a novel approach to explain the predictions made by data-driven methods. Since such rely heavily on data used for training, explanations that convey information about how training affects are useful. The quantify different data-clusters of affect prediction. quantification is based Shapley values, concept which originates from coalitional game theory, developed fairly distribute payout among set cooperating players. A player’s value measure contribution. values often feature importance, ie. features extends this cluster letting clusters act as players in where payouts. methodology proposed lets us explore and investigate any black-box model, allowing new aspects reasoning inner workings prediction model be conveyed users. fundamentally existing explanation methods, providing insight would not available otherwise, should complement including importance.